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Introduction 

This study examines the association between three outcomes of the freshman and 
sophomore years (retention, academic achievement and student rating of instruction) and 
the amount of exposure to three types of instructors (regular full-time faculty, adjunct 
faculty and graduate teaching assistants). 

The growing reliance in higher education on instructors who are not part of the 
permanent, full-time workforce that has traditionally constituted the professoriate is well 
documented. Since 1981, the number of part-time faculty employed by colleges and 
universities has grown by 79 percent, while the share of faculty hired on the traditional 
tenure track has grown at a much lower rate (Anderson, 2002). According to a report by 
the Coalition on the Academic Workforce (as cited in Cox, 2000) non-tenure track 
faculty make up almost half of the teaching staff in many humanities & social science 
disciplines. 

In this study, part-time faculty will be referred to as adjuncts. Adjuncts’ 
employment may be long or short-term, but is paid on a part-time contract outside of the 
regular faculty pay plan. Full-time instructors and lecturers on multi-year contracts but 
not on tenure-earning lines are included here with the regular, full-time faculty members. 

At this public research-intensive university, approximately 44% of the 
instructional faculty are adjuncts, and they deliver about 40% of the undergraduate 
courses. This is similar to their representation in other commuter student institutions in 
this state and near the median among this institution’s 14 peers. In the present study, 
faculty members taught about 51% of the first-year credit hours, adjuncts 31%, and 
graduate teaching assistants (referred to here as “GTAs”) 18%. Disciplines in the 
colleges of Arts and Letters and Science are most likely to employ GTAs. By the second 
year, faculty members are delivering 66% of the credit hours, adjuncts 25% and GTAs 
9%. 

The growing use of adjunct faculty is directly attributable to the leveling off of 
state support for higher education in the 1990’s (Gappa, 2000). Universities can offer a 
course by an adjunct for a fraction of what the same course would cost if taught by a 
regular faculty member. This cost-cutting measure helps keep lower-level undergraduate 
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courses at a reasonable size, and allows institutions the flexibility of increasing or 
decreasing course offerings as enrollments fluctuate (Anderson, 2002). 

But adjuncts are not by any means a homogeneous group. In addition to the 
“aspiring academics” who piece together part-time teaching assignments because full- 
time opportunities are not available, there are professionals, specialists and experts who 
bring the advantage of their primary careers to the classroom and without whom the 
university would not be able to offer students the latest technology or practitioner skills. 
Other adjuncts engage in part-time instruction as a transition to retirement or after 
retirement from full-time teaching. A fourth group of adjuncts are “free lancers” who 
prefer working simultaneously in several professions, one of which is teaching. (Gappa 
and Leslie, 1993). These different types of adjuncts may have different impacts on 
instruction. 



Background 

Concerns about the use of adjuncts center around several assumptions. One is 
that adjuncts and GTAs are professionally underdeveloped and scholarly weak, and that 
students are getting progressively shortchanged for every course delivered by a 
nonfaculty member (Carroll, 2003). However, the academic credentials required by 
regional accrediting agencies such as the Southern Association of Colleges and Schools, 
are identical regardless of who is delivering the instruction. There is no body of evidence 
indicating that part-timers teach any less effectively than regular full-time faculty 
(Haeger, 1998). 

Another perception of adjuncts is that they compromise the quality of higher 
education because they don’t have a full-time commitment to the university. Since the 
university has not invested in them with comparable salaries, benefits, support services, 
office space or job security, they are less likely to be fully integrated into campus life. 
This is consequential in light of the significant body of research pointing to the positive 
associations between bachelor’s degree completion and high levels of student 
involvement with faculty, with fellow students or with academic work (Pascarella & 
Terenzeni, 1991; Astin, 1993). Adjunct faculty may lack sufficient knowledge about the 
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institutional support services so critical to first-time-in-college students, and may be 
unprepared to identify at-risk behavior in students. 

Faculty members are likely to point out that adjuncts do not participate in the 
research and service missions of the university. They may also fear public perception 
that a university education can be delivered just as well and more cost effectively without 
making a lifetime commitment to the employment of full-time faculty. 

Although there have been a number of studies examining the changing 
composition of the workforce, these have generally centered on issues of job satisfaction, 
salary, benefits, and impact on institutional budgets. Most studies have failed to confront 
the most important question of all: What effect does the use of part-timers have on the 
quality of education? (Anderson, 2002). 

A handful of recent studies have attempted to examine the effect that exposure to 
part-time instructors has on student outcomes. Harrington & Schibik (2001) found that 
among students entering college in the fall semesters of 1997 to 2001, those not returning 
for the spring semester were more likely to have more than half of their courses taught by 
part-time instructors. They noted these students were also more likely to be male, have 
lower SAT and ACT composite scores, fewer first semester earned credits and a lower 
first semester GPA. 

Kehrberg & Turpin (2002) studied the effect of exposure to part-time faculty on 
college GPA and student retention. Preliminary findings of relationships between 
exposure to part-time faculty and each of these outcomes disappeared when academic 
preparation and first year experiences were controlled for. 

Generally, studies have focused on the direct relationships between exposure to 
adjunct faculty and student outcomes, without taking into effect the background 
characteristics and other enrollment experiences that may affect these outcomes. The 
present study attempts to remedy that knowledge gap by modeling student outcomes as a 
function of exposure to different instructor types while controlling first for variables 
known to be associated with these outcomes. 
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Data 

The population for the present study includes the 3,787 students who entered this 
university in Fall 2000 and Fall 2001 as first time in college (FTIC) students, out of a 
total enrollment of 25,000 students. Characteristics of the cohorts are displayed in Tables 
1 and 2. 

This study investigated the association between the amount of exposure to each of 
three types of instructor (faculty, adjunct, or GTA) and three outcome variables. 
“Retention” was defined as re-enrollment for the spring, the second fall and the third fall. 
“Academic achievement” was measured by cumulative GPA at the end of the first fall 
semester, after the first year and after the second year. Student satisfaction with 
instruction was examined using average ratings from the Student Perception of Teaching 
Instrument (SPOT) for lower division courses in which the cohort students were enrolled 
from fall 2000 through spring 2002. 

The outcome measures of college GPA and student retention were selected as 
objective indicators of student achievement and success. Variables selected for the 
retention and academic achievement models include conceptually-relevant characteristics 
available from the university’s student information system. Variables representing the 
student’s background are gender, race/ethnicity, high school GPA, and graduation in the 
top 20% of the high school class (“Talented 20”). Originally, SAT scores and their 
equivalents for ACT were included in the analysis, but these scores did not contribute to 
model fit beyond the information provided by high school GPA. “Enrollment 
Experience” variables include whether the student resided on-campus, the college of their 
first declared major, and type of financial aid received. In the retention models, 
cumulative GPA was included as a predictor. The final group of variables, instructor 
type, captures the essence of this study. Students were assigned to a category within 
each instructor type depending on the percentage of total credit hours attempted with that 
instructor type. 
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Table 1. Retention Rates of First Time in College (FTIC) Students Entering Fall 2000 and Fall 2001, by Study 

Variables 



Persist to Persist to 2 nd Persist to 3 rd 
N % of Cohort Spring Fall Fall 

Variable 



Total 


3,787 


1 00% 


87% 


67% 


52% 


Cohort 


Fall 2000 


1,788 


47 


88 


68 


53 


Fall 2001 


1,999 


53 


86 


65 


51 


Gender 


Male 


1,687 


45 


86 


66 


51 


Female 


2,100 


55 


87 


67 


53 


Ethnicity 


White 


2,346 


62 


86 


65 


50 


Black 


647 


17 


90 


70 


57 


Flispanic 


453 


12 


86 


66 


50 


Asian 


176 


5 


89 


74 


61 


Native American 


17 


0.4 


77 


71 


53 


International 


148 


4 


85 


68 


54 


College 


Architecture, Urban & Public Affairs 


170 


5 


87 


70 


58 


Arts & Letters 


582 


15 


89 


72 


56 


Business 


719 


19 


87 


65 


51 


Education 


307 


8 


87 


70 


58 


Engineering 


475 


13 


88 


70 


56 


Flonors 


159 


4 


93 


79 


64 


Nursing 


146 


4 


93 


77 


52 


Science 


602 


16 


89 


71 


55 


Undecided 


627 


17 


78 


49 


34 


First Term Housing 


In-Housing 


1.591 


42 


87 


65 


50 


Not in-housing 


2,196 


58 


86 


68 


54 


Talented 20 


Talented 20 


407 


11 


88 


74 


61 


Not Talented 20 


3,380 


89 


86 


66 


51 


High School GPA 


3,731 


99 


3.30-yes 

3.18-no 


3.34-yes 

3.17-no 


3.37-yes 

3.19-no 


Test Scores 


SAT-Verbal 


2,808 


74 


51 6-yes 
514-no 


51 8-yes 
512-no 


518-yes 

513-no 


SAT-Math 


2,808 


74 


527-yes 

516-no 


529-yes 

519-no 


530-yes 

520-no 


ACT 


1.313 


35 


22-yes 
21 -no 


22-yes 

21-no 


22-yes 
21 -no 


Financial Aid 


Loan 


1.141 


30 


88 


65 


51 


Grant 


1.265 


33 


89 


68 


55 


Scholarship 


2,037 


54 


91 


73 


59 


Instructor Type 
Faculty 


over 75% of credits 


404 


11 


87 


71 


55 


51-75% 


1.270 


34 


90 


69 


62 


26-50% 


1.600 


42 


90 


68 


46 


0-25% 


513 


14 


69 


52 


16 


Adjuncts 


over 50% of credits 


465 


12 


79 


59 


29 


26-50% 


1.701 


45 


89 


66 


53 


0-25% 


1.621 


43 


87 


69 


55 


GTAs 


over 25% 


1.079 


29 


86 


67 


37 


0-25% 


2,708 


71 


87 


66 


55 
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Table 2. Mean Cumulative GPAs of First Time in College (FTIC) Students 
Entering Fall 2000 and Fall 2001 , by Study Variables 





N 


% of Cohort 


1st Fall GPA 


1 st Year 
GPA 1 


2 nd Year 
GPA 1 


Variable 


Total 


3,787 


100% 


2.42 


2.44 


2.80 


Cohort 


Fall 2000 


1,788 


47 


2.44 


2.46 


2.78 


Fall 2001 


1,999 


53 


2.40 


2.42 


2.80 


Gender 


Male 


1,687 


45 


2.29 


2.33 


2.66 


Female 


2,100 


55 


2.52 


2.53 


2.89 


Ethnicity 


White 


2,346 


62 


2.49 


2.51 


2.85 


Black 


647 


17 


2.09 


2.11 


2.56 


Hispanic 


453 


12 


2.31 


2.35 


2.74 


Asian 


176 


5 


2.55 


2.50 


2.78 


Native American 


17 


0.4 


2.66 


2.70 


2.79 


International 


148 


4 


2.91 


2.97 


3.09 


College 

Architecture, Urban & Public 


Affairs 


170 


5 


2.35 


2.33 


2.71 


Arts & Letters 


582 


15 


2.63 


2.62 


2.82 


Business 


719 


19 


2.42 


2.44 


2.78 


Education 


307 


8 


2.44 


2.49 


2.87 


Engineering 


475 


13 


2.36 


2.39 


2.67 


Honors 


159 


4 


2.90 


2.94 


3.15 


Nursing 


146 


4 


2.34 


2.38 


2.76 


Science 


602 


16 


2.43 


2.45 


2.86 


Undecided 


627 


17 


2.17 


2.16 


2.62 


First Term Housing 


In-Housing 


1,591 


42 


2.34 


2.36 


2.74 


Not in-housing 


2,196 


58 


2.48 


2.50 


2.83 


Talented 20 


Talented 20 


407 


11 


2.79 


2.83 


2.96 


Not Talented 20 


3,380 


89 


2.37 


2.39 


2.77 


High School GPA 


3,731 


99 


r=.42 


r=.47 


r=..49 


Test Scores 


SAT-Verbal 


2,808 


74 


r= 22 


r=.27 


r=.30 


SAT-Math 


2,808 


74 


r= 25 


r=.27 


r=.27 



ACT 


1,313 


35 


r=.36 


r=.40 


r=.42 


Financial Aid 


Loan 


1,141 


30 


2.32 


2.24 


2.64 


Grant 


1,265 


33 


2.39 


2.35 


2.77 


Scholarship 


2,037 


54 


2.71 


2.68 


3.09 


Instructor Type 
Faculty 


over 75% of credits 


404 


11 


2.61 


2.72 


2.84 


51-75% 


1,270 


34 


2.42 


2.48 


2.78 


26-50% 


1,600 


42 


2.37 


2.36 


2.80 


0-25% 


513 


14 


2.41 


2.35 


2.72 


Adjuncts 


over 50% of credits 


465 


12 


2.38 


2.28 


2.78 


26-50% 


1,701 


45 


2.37 


2.40 


2.75 


0-25% 


1,621 


43 


2.48 


2.52 


2.81 


GTAs 


over 25% 


1,079 


29 


2.35 


2.40 


2.79 


0-25% 


2,708 


71 


2.43 


2.46 


2.78 



’For students enrolled for both Fall and Spring 
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Background variables were selected because of their known association with the 
outcomes we selected. Tinto (1975), as well as Terenzini & Pascarella (1978) emphasized 
the importance of individual attributes and academic preparation/qualifications as 
predictors of college student retention. Tinto’ s longitudinal model of dropout includes 
attributes such as sex and race and measures of ability as obtained on a standardized test 
or demonstrated through high school grade performance. Pre-college characteristics 
included by Terenzini & Pascarella included sex, race/ethnic origin, initial (academic) 
program of enrollment, academic aptitude (standardized test scores), and high school 
achievement (measured as high school class percentile rank). 

A third outcome measure, student ratings of instruction, was examined to 
determine whether students perceive a difference in their classroom experiences with 
different types of instructors. Ratings measure the student’s satisfaction with instruction, 
an important component of the educational experience. Moreover, student ratings have 
been determined to be relatively valid against a variety of indicators of effective teaching 
(d’Apollonia & Abrams, 1997; Marsh, 1987). Therefore, they may be more relevant 
outcome measures than either retention or GPA. 

The analysis of student perception of teaching compared average ratings on nine 
SPOT items by instructor type. Although the characteristics of the students enrolled in 
those courses were known, on average only about two-thirds of enrolled students 
complete the SPOT. Rather than assume that the nonresponse was random, we decided 
to limit the analysis to class average data only, but adjust for two correlates known to 
affect student ratings of instruction: course discipline and class size. 

Several statistical methods were used to analyze these data. Descriptive statistics 
provide a picture of the population cohorts on the study variables and their relationship 
with the outcome variables of retention and academic achievement. Multivariate 
techniques (logistic regression and OLS regression) were used to assess whether 
background variables, enrollment experience variables, and instructor type were 
associated with these outcomes. Analysis of covariance was used to compare student 
ratings of instruction by instructor type. These are further described below. 
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Statistical Methods 

Retention 

Logistic regression was used to assess the effect of the study variables on 
persistence because it is well-suited for the study of dichotomous outcome variables, and 
is the most appropriate technique to use with a mixture of categorical and interval 
independent variables. (Feinberg, 1983; Cabrera, 1994; Peng et. al., 2002). Logistic 
regression estimates how various factors will influence the probability that a particular 
outcome might happen. The use of dichotomously coded independent variables leads to a 
more straightforward interpretation of probability outcomes, although continuous 
variables can be used. In this study, all variables were dichotomously coded except for 
GPA. When a variable is comprised of more than two discrete categories (ethnicity, 
major, financial aid, instructor type) sets of dichotomous variables were created 
indicating the presence or absence of the characteristic. This approach necessitates that a 
reference category be created, and these are noted on the tables. For continuous 
variables, linearity in the logit was confirmed through the grouping procedure 
recommended by Hosmer and Lemeshow (1989). Collinearity among independent 
variables was estimated through inspection of tolerance levels obtained using a linear 
regression model (Menard, 1995). 

The sequential approach to logistic regression was used to enter blocks of 
variables in order to examine the contribution of each block, first in relation to the 
baseline (intercept-only) model and then in succession. Three sets of variables were 
examined sequentially, entering the model in chronological order, with student 
characteristics (background) entered first, then variables reflecting enrollment experience 
during the relevant terms. Type of instructor was entered last, allowing all other 
variables to exert their influence before testing the variables of most interest in this study. 
Results are displayed in Table 3. 

For the final model, the standardized beta weights represent the importance of 
each variable, controlling for all others, on the logit. Although the sign associated with 
the beta weight indicates the direction of the association of the independent variable with 
the outcome, the coefficients themselves are expressed in logits rather than in the original 
scale of measurement. In the case of categorical variables, the interpretation of the 
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coefficients is a function of the excluded, or reference, category. Because of these 
complications, it is customary to use the delta-p statistic to display the effect that the 
independent variables have on the outcome (Cabrera, 1995; Peng et. al., 2002). Delta-p 
is the impact that each significant variable makes on the probability of retention, 
controlling for all other variables in the model. For the dichotomous variables in the 
model, delta-p provides an estimate of the change in the probability of retention for 
students having that characteristic compared to those who do not. For continuous 
variables like high school GPA, delta-p is an estimate of the change in the probability of 
retention associated with a one-point change in high school GPA. For this study, delta-p 
statistics were computed using the formula developed by Petersen (1985), and are 
expressed as a change of percentage points in a baseline percentage. 

Goodness of fit for the entire logistic model is given by the pseudo R , the 
proportion of cases correctly predicted by the model, and the chi-square statistics for 
overall fit. Pseudo-R" represents the proportion of error variance that an alternative 
model reduces in relation to the intercept-only model (Cabrera, 1994). Pseudo-R' was 
computed using the formula recommended by Aldrich and Nelson (1984), who also 
recognize that R“ from logistic regressions are generally lower than the R“ estimated with 
OLS. These authors also suggest that the proportion of cases correctly predicted (PCP) 
by the logistic regression model provide an overall indicator of fit analogous to the OLS 
R', with large PCPs indicating that the model provides a good fit to the data. Finally, the 
chi-square for overall fit tests the null hypothesis that the independent variables as a 
group have no effect on retention. 

Academic Achievement 

The more familiar ordinary least squares (OLS) regression analysis was used to 
test hypotheses about the effect of background variables, enrollment experience variables 
and instructor type on students’ academic achievement, as measured by cumulative 
GPA’s at three points in time. After examining several different approaches, a stepwise 
solution was selected to obtain the smallest subset of predictors. Table 4 displays the 
results of the final models with the unstandardized and standardized regression 
coefficients for the independent variables that were statistically significant in predicting 
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Table 3. Final Logistic Regression Models of Retention on Study Variables 



First spring Second fall Third fall 

Beta Delta-p Beta Delta-p Beta Delta-p 

BACKGROUND VARIABLES 
Cohort 



2001 entering cohort 


-.146 




-.132 




.026 


Gender 












Male 


.043 




.271 




004 


High School GPA 


-.565 *** 


-7.8% 


-.184 * 


-4.2% 


-.032 


Talented 20 


-.230 




.001 




-.089 


Race/Ethnicity 1 












Black 


.652 *** 


+6.2% 


.492 *** 


+10.2% 


.129 


Hispanic 


-.086 




-.008 




-.064 


Asian American 


.007 




.256 




.018 


Native American 


-.528 




.419 




-.542 


International 


-.132 




.020 




-.358 


ENROLLMENT EXPERIENCE 
Housing 












On campus first year 


.016 




-.113 




N/A 


College of First Major 2 












Business 


-.132 




-.285 ** 


-6.1% 


.069 


Education 


-.121 




-.017 




.129 


Engineering 


-.157 




-.165 




.036 


Nursing 


.539 




.256 




-.649 * -14.2% 


Science 


-.077 




-.176 




.040 


Honors 


.007 




.042 




.150 


Arch, Urban & Public Affairs 


-.136 




-.069 




.641 


Undecided 


-.591 *** 


-7.2% 


- .742 *** 


-17% 


-.215 


Financial Aid 3 












Grants 


.144 




.144 




.418** +.7.2% 


Loans 


-.053 




-.071 




-.215 


Scholarships 


.543 *** 


+6.7% 


.239 ** 


+5.6% 


.004 


Cumulative FAU GPA 


.817 *** 


+6.8% 


.829 *** 


+15.3% 


.702 *** +1 1 .2% 


INSTRUCTOR TYPE 
Faculty 4 












0% to 25% 


-.214 




-.589 *** 


-13.9% 


.377 


51% to 75% 


-.198 




.082 




-.061 


Over 75% 


.065 




.129 




-.132 


Adjuncts 5 












0% to 25% 


-.088 




-.098 




.154 


Over 50% 


.159 




.229 




-.139 


Graduate Teaching Assts. 6 












Over 25% 


.147 




.222 




-.105 


Constant 


1.95 *** 




-.442 




-.274 


Model Indicators 

Baseline p 


87% 




67% 




74% 


Model N 


3787 




3787 




2517 


-2 Log L 


2344.24 




4013.46 




1817.42 


Chi-square (df) 


330.33 (6) 




611.43 (9) 




73.81 (8) 


Pseudo R 2 


.09 




.15 




.04 


% correctly predicted 


83% 




74% 




82% 



***p<.001,**p<.01 , * p < .05 

1 Reference category = White 

2 Reference category= Arts and Letters 

3 (1= Yes 0 = No) 

4 Reference category = 26% to 50% 

5 Reference category = 26% to 50% 

6 Reference category = 0% to 25% 
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Table 4. Final OLS Regression Models of GPA's on Study Variables 







First Fall GPA 


First Year GPA 


Second Year GPA 




b 


SE b 


Beta 


b 


SEb 


Beta 


b 


SE b 


Beta 


BACKGROUND VARIABLES 
Cohort 




















2001 entering cohort 


-.077 


(-.030) 


-.038 * 


-.091 


(.029) 


-.046 ** 


.002 


(. 022 ) 


.001 


Gender 




















Male 


-.129 


(.034) 


-.062 *** 


-.124 


(.032) 


-.062 *** 


-.114 


(.024) 


_ 094 *** 


High School GPA 


.656 


(.035) 


.348 *** 


.640 


(.033) 


.350 *** 


.338 


(.023) 


.316 *** 


Race/Ethnicity 1 




















Black 


-.197 


(.044) 


_ 073 *** 


-.212 


(.043) 


_ 081 *** 


-.221 


(.033) 


. 140 *** 


Hispanic 


-.104 


(.047) 


-.033 * 


-.104 


(.045) 


-.034 * 


-.077 


(.035) 


-.041 * 


International 


.462 


(.094) 


.073 *** 


.496 


(.090) 


.080 *** 


.315 


(.062) 


.092 *** 


Asian 














-.124 


(.048) 


- 047 ** 


ENROLLMENT EXPERIENCE 




















College of First Major 2 




















Business 


-.210 


(.052) 


_ 079 *** 


-.183 


(.047) 


_ 071 *** 








Education 


-.247 


(.065) 


-.066 *** 


-.185 


(.060) 


-.051 ** 








Engineering 


-.304 


(.059) 


_ 098 *** 


-.306 


(.054) 


-.102 *** 


-.147 


(.041) 


_ 082 *** 


Nursing 


-.212 


(.086) 


-.040 * 














Science 


-.336 


(.053) 


_ 120 *** 


-.292 


(.048) 


-.108 *** 








Honors 


-.580 


(.087) 


-.115 *** 


-.308 


(.097) 


-.063 ** 


-.183 


(.056) 


-.070 *** 


Arch., Urban and Public Affairs 


-.217 


(.080) 


_ 044 ** 


-.182 


(.074) 


-.038 * 








Undecided 


-.425 


(.053) 


- .154 *** 


-.415 


(.048) 


-.155 *** 


-.204 


(.042) 


- 104 *** 


Financial Aid 3 




















Grants 








.080 


(.035) 


.038 * 








Loans 


-.080 


(.034) 


-.036 * 


-.101 


(.035) 


-.047 ** 


-.122 


(.027) 


-.091 *** 


Scholarships 


.108 


(.037) 


.053 ** 


.103 


(.035) 


.052 ** 


.371 


(.025) 


.309 *** 


INSTRUCTOR TYPE 
Faculty 4 




















Over 75% 








-.192 


(.059) 


-.060 ** 








Adjuncts 5 




















Over 50% 








-.105 


(.044) 


-.034 * 








Constant 


-.521** 


(.163) 




-.656*** 


(.154) 




1.631*** 


(.083) 






Adjusted R 2 = 


:.237 


Adjusted R 2 = 


.258 


Adjusted R 2 = 


.373 



*** p<.001,** p<.01,* p<.05 



1 Reference category = White 

2 Reference category= Arts and Letters 

3 (1= Yes 0 = No) 

4 Reference category = 26% to 50% 

5 Reference category = 26% to 50% 
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2 

the outcome. The R for the OLS regression equations indicates the percentage of 
variance in GPA attributable to the significant predictors in the model. 

Student Satisfaction with Instruction 

The third analysis tested whether students differed in their ratings of faculty, 
adjuncts and GTAs on the Student Perception of Teaching (SPOT) instrument. Nine of 
the 29 total SPOT items were selected for analysis because they might be expected to 
differ by instructor type, such as availability of instructor, use of class time, and concern 
for students. Analysis of covariance was used to compare mean ratings by instructor type 
while controlling for class size, a variable known to be related to student ratings of 
instruction (Marsh, 1987). Because the colleges make different use of the various 
instructor types, and because ratings can vary widely by discipline, it was decided to 
conduct separate analyses for each college. 

Assumptions for homogeneity of variance were tested using Levene’s Test of 
Equality of Error Variance for each SPOT item by college. Where the assumption of 
equal error variance was not met, data transformations were undertaken to help 
symmetrize within-group distributions and improve their spread. 

For each SPOT item, pairwise comparisons among the three instructor types were 
computed, and the results reaching statistical significance were reported in Table 5 with 
‘plusses’ and ‘minuses’, along with their significance level. The comparisons were done 
in this manner rather than reporting mean ratings for two reasons. First, the scales 
underlying the items vary, with several using a Likert-type agreement scale, and others 
using ratings that indicate, for example, pace of the course, or amount learned. Second, 
students tended to rate instructors quite favorably, and the absolute rating or even the 
difference in average ratings was of less interest than simply the direction of the 
difference. The Bonferroni method was used to adjust for multiple comparisons. 
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Table 5. Comparison by Instructor Type of Average Ratings on Selected Student Perception of Teaching Items 



(Significance levels in parentheses) 











College 






SPOT Item 


Comparison 


Arts & Letters 


Business 


Education 


Engineering 


Honors 


Science 




Faculty to adjunct 


+ (.01) 


+ (.01) 






+ (.05) 




Was available during 
office hours or 


Faculty to GTA 












- (.05) 


appointment times 


Adjunct to GTA 


-(.01) 










-(.01) 




Faculty to adjunct 


- (-05) 








+ (.05) 




Used class time 
effectively 


Faculty to GTA 












-(.01) 




Adjunct to GTA 












-(.01) 




Faculty to adjunct 




+ (.05) 


- (.05) 




+ (.05) 




Seemed concerned 
with whether students 


Faculty to GTA 








- (.05) 




-(.001) 


learned 


Adjunct to GTA 












-(.001) 




Faculty to adjunct 




+ (.01) 










Respect and concern 
for students 


Faculty to GTA 


- (-05) 










-(.001) 




Adjunct to GTA 












-(.01) 




Faculty to adjunct 




+ (.01) 




- (.05) 






Willing to listen to 
students' questions and 


Faculty to GTA 


- (-05) 




- (.05) 






-(.001) 


opinions 


Adjunct to GTA 












-(.001) 




Faculty to adjunct 


-(.01) 


+ (.05) 






+ (.01) 




Pace at which the 
instructor covered the 


Faculty to GTA 


+ (.01) 


+ (.05) 








+ (.001) 


material ( + = faster) 


Adjunct to GTA 


+ (.001) 










+ (.001) 




Faculty to adjunct 


+ (.01) 




+ (.01) 




+ (.001) 




Effort you put into this 
course 


Faculty to GTA 


+ (.05) 






- (.05) 




+ (.001) 




Adjunct to GTA 








- (.05) 




+ (.001) 




Faculty to adjunct 


+ (.05) 


+ (.05) 






+ (.01) 




Overall rating of 
instructor 


Faculty to GTA 












-(.01) 




Adjunct to GTA 












- (.05) 


Compared to other 


Faculty to adjunct 


+ (.05) 








+ (.001) 




instructors you have 
had ( + = more 


Faculty to GTA 














effective) 


Adjunct to GTA 














Number of courses taught by faculty 


444 


54 


24 


33 


146 


196 


Number of courses taught by adjuncts 


333 


33 


41 


7 


7 


112 


Number of courses taught by GTAs 


280 


2 


11 


20 


0 


455 



Lower division classes only 

Fall 2000 - Spring 2002 excluding summers 
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Bivariate Results 

As shown in Table 1, 87% of the study cohort returned for a first spring semester, 
67% for a second fall, and 52% for a third fall term. Black and Asian- American students 
were more likely to persist during the first year, and students who did not declare an 
initial major were less likely to return at all points in time. Students with higher high 
school GPAs and test scores are more likely to persist, and scholarship or grant recipients 
have the retention edge over those receiving loans. Table 1 shows that higher exposure to 
faculty and less exposure to adjuncts generally results in higher retention rates. Less 
exposure to graduate teaching assistants results in a higher retention rate to the third fall. 

Table 2 shows a mean cumulative GPA for the first fall of 2.42, for the first year 
of 2.44, and for the second year of 2.80. Female students had higher GPAs, as did 
international students. Students in the Honors College earned the highest GPAs, and 
undecided students earned the lowest GPAs. Students in the “Talented 20” earned higher 
GPAs, although the gap narrows with time. Correlations between high school GPA and 
cumulative GPA are in the moderate range (.42 to .49), and correlations between test 
scores and cumulative GPA fell in the low to moderate range (.22 to .42). Scholarship 
and grant students have a GPA edge over students receiving loans. Greater exposure to 
faculty and less to adjuncts and graduate teaching assistants appears to result in higher 
GPAs through the first year, but seems to have little association in the second year. 

The more favorable retention and achievement results associated with greater 
exposure to faculty instruction is consistent with the findings of other studies. However, 
it is plausible that students who are more likely to take courses with faculty share other 
characteristics that predispose them to academic achievement. The multivariate models 
will help unravel these effects. 



Multivariate Results 

Instructor Type and Retention 

Table 3 displays the effects on retention of the study variables. Initially, the most 
influential variable is high school GPA; a one point increase in high school GPA reduces 
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retention to the first spring by 7.8 percentage points. This effect carries over to the 
second fall retention, although its impact is lessened, and it disappears altogether for 
retention to the third fall. The negative effect of high school GPA on retention seems 
counterintuitive; we would not expect better academic preparation to decrease retention. 

This example illustrates the need to exercise care in interpreting logistic 
regression results, particularly where independent variables are correlated. Other 
significant predictors in the model, especially receipt of a scholarship and cumulative 
GPA, are associated with an increase in retention. After controlling for these predictors, 
the effect of high school GPA on the probability of retention diminishes. Further, delta-p 
must be interpreted not as a constant, but against its starting value before the one point 
change in the value of the predictor (Long, 1997). The average FTIC student enters the 
university with a high school GPA of 3.2. Thus, the 7.8 percentage point drop in 
retention indicates that once the effects of scholarship and GPA are taken into account, 
the university is more likely to lose those students with the best academic preparation 
(average high school GPA of 4.2) to transfer institutions. 

Entering the university without declaring a major lowers retention by 17 
percentage points by the second fall. By the third fall, the effect of not declaring a major 
is no longer statistically significant. Among racial/ethnic groups, being black was 
associated with increased retention through the second fall. Student surveys consistently 
demonstrate that black students exhibit a high level of satisfaction with their experience 
at this university. By the third fall, however, students on academic probation, who are 
disproportionately black, were no longer allowed to continue. Not unexpectedly, 
receiving a scholarship had a positive impact on retention, at least through the second 
fall. The retention advantage shifts to grant recipients by the third fall. Business majors 
face more demanding coursework and students who entered intending to be nursing 
majors may not be admitted into the program in their junior year. A higher cumulative 
GPA can be expected to result in greater retention. 

After background and enrollment experience variables have exerted their effects 
on retention, very little additional information was added by the amount of exposure that 
students have to various types of instructors. The only significant effect occurred where 
those students who had taken less than one quarter of their credit hours during their 




17 



freshman year with full-time faculty could be expected to experience a drop of almost 14 
percentage points in their retention to a second fall. 



Instructor Type and Academic Achievement 

Inspection of the standardized regression weights in Table 4 reveals that the 
largest impact on cumulative GPA was high school GPA. Negative effects on GPA 
include being male, being in an ethnic minority group, entering without a declared major, 
and receiving loans. Students in the reference category for college of first major, Arts 
and Letters, tended to earn higher GPAs, resulting in negative effects on GPA for 
declaring majors in other colleges. The negative effect on GPA for Honors students runs 
counter to the results of the bivariate analysis, where these students earned the highest 
GPAs. However, the average high school GPA for Honors students is over 4.0, and once 
the effects of this largest predictor were removed, the connection between college and 
cumulative GPA was less straightforward. 

The regression model for first fall GPA detected no effects for instructor type 
beyond those accounted for by other variables in the model. Students who took more 
than 75% of their credit hours with faculty could expect lower first year GPAs; there was 
a smaller negative effect for students who took over half of their courses with adjuncts. 
There was no instructor type effect on the second year GPA. 

Instructor Type and Student Satisfaction 

Results of the comparison by instructor type of average ratings on selected items 
on the Student Perception of Teaching instrument are shown in Table 5. What may be 
most surprising is how few statistically significant differences exist in ratings among 
instructor types. In those colleges where differences existed, faculty members were rated 
more available than adjuncts. In the College of Business, faculty members were rated 
more favorably than adjuncts on most items. In the College of Science, GTAs teach more 
courses than the other instructor types combined, and they were particularly popular. 
Students viewed them as being more available, making more effective use of class time, 
being more concerned with whether students learn, being more respectful, and being 
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more willing to listen to their questions and opinions. However, GTAs tended to cover 
the course material at a slower pace, and students said that they put more effort into 
courses taught by faculty and adjuncts. The College of Engineering showed some of the 
same effects in comparison of GTAs with other instructor types. In the College of Arts 
and Letters, faculty members were rated more highly than adjuncts on some items, but 
were seen as using class time less effectively and covering the course material less 
quickly. GTAs in Arts and Letters were also judged more respectful and concerned for 
students, and willing to listen to questions and opinions. 

Discussion 

This study uncovered little evidence that instructor type has a widespread impact 
on student outcomes. Rather, the study demonstrated that retention and academic 
achievement can be predicted primarily from background and educational experience 
variables. Student ratings of instruction vary widely by college, with faculty having the 
edge in some areas, and GTAs in others. Adjuncts rarely showed any statistically 
significant differences in their comparisons to other instructor types. The negative effect 
on first-year GPA from taking a large percentage of credit hours from faculty may be 
related to the perception reported on the SPOT that these courses require more effort, and 
are perhaps more rigorous. 

However, the almost 14 percentage point drop in retention to the second fall for 
students with the least exposure to faculty merits further investigation. This group 
comprised about 14% of the study cohort, or 513 students. They attempted, on the 
average, the same number of credit hours as other students. There was nothing measured 
in this study that distinguished them from other groups except for the greater proportion 
of credit hours taken from adjuncts and GTAs. The negative effect does not carry 
through to the third fall, but after two years, fewer students have this low level of 
exposure to faculty. Only eight percent had taken fewer than 25% of their credit hours 
with faculty, and almost half had faculty exposure at the 51% - 75% level. 

The attrition for students with low faculty exposure, coupled with the significantly 
lower retention rates of students who enter without a declared major, suggest that the 
kind of involvement with the university that research demonstrates is critical for retention 
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is lacking for students who are in these categories. Recognizing the risk, the university 
has already begun to add interventions directed toward undecided majors, including 
earlier advising and creation of a learning community for these students. The university 
might also be well advised to monitor freshman course taking to ensure adequate 
exposure to full-time faculty members. 



Limitations 

One limitation of this study is that the outcome variables used are only gross 
indicators of students’ academic experiences. Students have many reasons for leaving, 
or for failing academically, many of them unrelated to their experiences in the classroom 
and outside the control of the university. Even student ratings, although providing a 
glimpse into the instructor’s perceived effectiveness, do not provide direct evidence of 
how the instructor influences the student’s educational experience. If the concern with 
over-reliance on part-time faculty or GTAs is that educational quality will suffer as a 
result, more direct measures of these constructs are needed. 

The link between experiences with instruction and student outcomes may have 
less to do with the type of instructor than his or her ability to convey information 
effectively to students. In its comprehensive standards on faculty, the Commission on 
Colleges of the Southern Association of Colleges and Schools requires institutions to 
consider in its faculty, whether full or part-time, “competencies and achievements that 
contribute to effective teaching and student learning outcomes.” It is the responsibility of 
the university to ensure that whomever is in the classroom has the tools to make this 
happen. 
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